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Abstract. For distant extragalactic sources of gamma- 
rays in the PeV (10 15 eV) energy range, interactions of 
the gamma rays with intergalactic diffuse radiation fields 
will initiate a pair cascade. Depending on the magnetic 
fields in the vicinity of the source, the cascade can ei- 
ther result in an isotropic halo around an initially beamed 
^ ■ source, or remain more or less collimated. Data recorded 
v> , by the HEGRA system of imaging atmospheric Cherenkov 
5_j ■ telescopes are used to derive limits on the halo flux from 
the AGN Mrk 501. This is achieved by comparing the 
angular distribution of TeV gamma-rays during the 1997 
burst phase - where direct photons should dominate - 
with the distribution during the 1998/99 quiescent state, 
where a steady-state halo contribution should be most 
pronounced. The results depend on the assumptions con- 
cerning the angular distribution of the halo; limits on the 
halo flux within 0.5° to 1° from the source range between 
0.1% and 1% of the peak burst flux. 

Key words: galaxies: BL Lacertae objects: individual: 
Mkn 501 - gamma rays: observations 
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1. Introduction 

High-energy gamma rays have a limited mean free path 
in the universe, due to interactions with the intergalactic 
soft photon radiation, resulting in pair production (Nik- 
ishov 1962, Goldreich & Morrison 1964, Gould & Schreder 
1966, Jelley 1966, Stecker et al. 1992). For (head-on) col- 
lisions of a gamma ray of energy E with a photon of 
wavelength A, the pair production threshold is crossed 
if A < 2.4 i?(^m/TeV). At PeV energies, interactions 
with the microwave background radiation limit the mean 
free path of gamma rays to galactic distance scales. At 
lower (TeV) energies, infrared or optical photons are re- 
quired to cross the pair production threshold, and the 
mean free path rapidly grows with decreasing energy to 
Mpc scales and beyond. When a source injects very high- 
energy gamma-rays into this photon background, a cas- 
cading process will start, where the gamma ray converts 
into a pair, the electron and positron in turn Compton- 
scatter background photons to high energy, which again 
produce a pair, and so on until the energies are so low that 
the medium is transparent to these gamma-rays, on the 
scale of the distance between source and observer (Aha- 
ronian & Atoyan 1985, Protheroe 1986, Zdziarski 1988, 
Protheroe & Stanev 1993, Blandford & Levinson 1995). 
The cascading process results in universal photon energy 
spectra, almost independent of the energy of the primary 
photons. The cascade photons modify the spectrum of di- 
rect photons from the source, since cascade photons pile 
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up around the energy where the medium becomes trans- 
parent. In essence, the energy content in very high-energy 
photons is transposed into photons of lower energy. To 
which extent the spectrum of direct photons is modified 
by the cascade photons depends on the spectral index and 
on the high-energy cutoff of the primary radiation. If the 
source emits well into the PeV region, and if the spectrum 
resembles a power law dN/dE ~ E~ a with index a ~ 2 
- with equal amount of power per decade of energy - the 
yield of cascade photons is comparable to the number of 
direct photons. If, on the other hand, the source cuts off 
at lower energies, or if the primary spectrum is steeper, 
the energy content of the high-energy photons is small 
compared to the energy density at lower energies, and the 
cascade photons represent only a small correction to the 
spectrum. Already an index of 2.2 suffices to reduce the 
influence of cascade photons dramatically (Protheroe & 
Stanev 1993). 

While the discussion given so far concerns the spectral 
distribution of all photons produced by the source and the 
cascading effect, relevant e.g. for the description of the dif- 
fuse gamma-ray background resulting from the superpo- 
sition of many unresolved point sources, cascading is also 
relevant for the angular distribution of photons from indi- 
vidual point sources and may give rise to a halo surround- 
ing distant high-energy sources such as AGNs (Aharonian 
et al. 1994, 1995). If the magnetic fields in the vicinity 
of the source are such that the average mean free path 
between cascade steps - at least during the initial stages 
of the cascade - is large compared to Larmor radii, the 
cascade will generate, even for highly beamed primary 
sources, an isotropic halo. Concerning the intergalactic 
part of the pair cascade, the required fields are in the range 
of some nG to some ten nG (Aharonian et al. 1994), and 
while little is known about intergalactic magnetic fields, 
such values are not implausible, and are seen at least in 
the halos of galaxies and in clusters of galaxies (Kronberg 
1996, Eilek 1999). For sources such as the AGNs Mkn 501 
or 421, with characteristic distances around 140 Mpc (for 
H = 65 km/s/Mpc), halo sizes have been estimated to a 
few degrees (Aharonian et al. 1994, 1995). 

Since the isotropic cascade proceeds over large, typ- 
ically Mpc scales, the halo intensity will be constant in 
time, compared to the variable nature of the direct radi- 
ation. From simple geometrical arguments, one finds that 
the characteristic time scale T governing the evolution of 
the halo flux seen at an angular distance from a source 
at a distance d is given by 

T «^«4.10 5 v 

c J 

in case the halo is generated in the vicinity of the source; 
for the numerical estimate 9 = 0.05° is used, the smallest 
scale where a halo might be detectable, given the angu- 
lar resolution of the instrument, and d — 140 Mpc. The 
shortest time scale is possible if the cascades are generated 



half-way between the source and the observer, in a region 
of small magnetic fields and low deflection angles, 



One might, therefore, speculate that the very low 
quiescent-phase TeV gamma-ray flux from AGNs such as 
Mkn 421 or 501 represents the halo flux, onto which di- 
rect photons from burst events are superimposed. In such 
a scheme, the ratio of the isotropic halo flux Fnaio to the 
typical flux in bursts Fsurst can be estimated as 

FHalo/F B urst « T D f 

where r is the ratio of the energy flux in the PeV and TeV 
energy ranges provided by the source, D is the duty cy- 
cle, i.e. the fraction of the time the source is in the 'burst' 
state, and / is the beaming fraction, assuming that the ob- 
server is located in the center of the beam for burst events. 
Assuming a flat spectral energy distribution of the source 
(r w 1), a beaming fraction 0(1/100) and a duty cycle of 
0(1/10) - one predicts a halo flux which is at least a factor 
of 1000 below the peak flux. On the other hand, if recent 
data on the strength of the infrared background and their 
implication concerning the source spectra are taken liter- 
ally - see e.g. Protheroe & Meyer (2000) - reconstructed 
source spectral energy distributions rise steeply at high 
energy, implying very large values of r, O(10 2 ) to O(10 4 ) 
and a halo flux comparable to the burst flux. Also, smaller 
intergalactic magnetic fields could result in a beamed halo 
and a corresponding increase in halo flux. In the extreme 
case, with fields as low as 10 -20 G, as discussed by Plaga 
(1995) and Kronberg (1995), the intergalatic part of the 
cascade is so well collimated that for all practical purposes 
it cannot be resolved. 

This paper describes a search for a TeV gamma-ray 
halo surrounding Mkn 501, using the large data base ac- 
cumulated with the HEGRA system of imaging atmo- 
spheric Cherenkov telescopes in the years 1997 through 
1999. While Mkn 501 is not the ideal candidate for a halo 
source - given its relatively modest luminosity and the fact 
that the 'ideal' distance to observe halos is in the range 
of several 100 Mpc to 1 Gpc (Aharonian et al. 1994), the 
uncertainties in the model expectation are significant and 
motivate an experimental search for a gamma-ray halo. 

2. The Mkn 501 data set and the event selection 

The AGN Mkn 501 has been observed on a regular ba- 
sis during the observation (visibility) periods since 1997 
using the HEGRA system of five imaging atmospheric 
Cherenkov telescopes, located on the Canarian Island of 
La Palma on the site of the Observatorio del Roque de 
los Muchachos. The HEGRA telescope system allows the 
stereoscopic reconstruction of air showers above a thresh- 
old of 500 GeV, and provides event-by-event a determina- 
tion of the photon direction with a precision of typically 
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0.1°, and of the photon energy with a resolution of better 
than 20% (Konopelko et al. 1999). 

The following analysis is based on the 1997 data set, 
acquired during the burst phase of Mkn 501 and described 
in detail by Aharonian et al. (1999a, 1999b), and on the 
1998/1999 quiescent-phase data set, described by Aharo- 
nian et al. (2000a). With exceptions detailed below, the 
same methods for data selection and event reconstruction 
were applied to the data sets in this analysis. 

In order to search for halo components, it is impor- 
tant to control the point spread function of the instrument 
and to reduce as much as possible tails in the point spread 
function. Therefore, the techniques described by Hofmann 
et al. (2000) were applied to reconstruct the shower geom- 
etry from the observed Cherenkov images, providing, for 
each shower, an error estimate for the direction of the 
photon. Well-reconstructed photons were then selected by 
requiring an error of less than 0.1° in each projection, 
keeping slightly more than 50% of all photons. The same 
approach, with an even tighter selection, has already been 
applied in a study of the size of the TeV gamma ray source 
in the Crab Nebula (Aharonian et al., 2000b). 

Past HEGRA studies of the TeV gamma radiation 
from Mkn 421 and Mkn 501 (Aharonian et al. 1999a, 
1999b, 1999c, 2000a) or the Crab nebula (Aharonian et al. 
1999d) used rather loose cuts to select gamma ray events, 
in order to minimize systematic errors. For the present 
study, to gain maximal sensitivity for a faint halo, tighter 
cuts were applied; the basic idea is to determine the ra- 
tio of halo intensity to direct flux with tight cuts, and 
then derive an absolute halo flux by multiplying this ratio 
with the absolute flux determined with loose cuts for the 
direct radiation. Gamma-ray selection cuts are based on 
the mean scaled width of images (Aharonian et al. 1999a), 
where gamma-rays appear as a roughly Gaussian peak at 
1 with a width of about 10%, whereas nuclconic cosmic 
rays generate a broad distribution at larger mean scaled 
width values. Both simulations and Crab and Mkn 501 
data show that the best sensitivity for faint sources is 
achieved with a cut requiring a mean scaled width below 
1.05 to 1.10, compared to cuts at 1.2 to 1.3 in analyses aim- 
ing at a precision determination of the flux and spectrum 
of strong sources. Here, a cut at 1.1 is used, significantly 
increasing the rejection of cosmic-ray induced events. The 
slightly increased systematic errors in the determination 
of the absolute flux [] are still negligible in the determina- 
tion of flux limits, and in any case cancel to a large extent 
when the ratio of the halo flux to the central direct flux is 
taken. 



For the selection of events used in this analysis, the cut at 
1.1 retains (84 ±5)% of all gamma rays, compared to (97 ±2)% 
for a cut at 1.2, and 99% at 1.3. 



3. Search for a gamma-ray halo 

Depending on the angular distribution of the halo radia- 
tion, a halo can manifest itself in different ways in obser- 
vations with Cherenkov telescopes: 

— A component of the halo whose angular spread is very 
small compared to angular resolution of the instrument 
- about 4' for the data set discussed here - will be 
superimposed onto the direct radiation and cannot be 
resolved. This limits in particular the detection of the 
collimated halos generated by cascades in regions of 
very small magnetic fields. 

— A component with an angular spread comparable to 
the instrumental resolution will result in a widening of 
the angular distribution, without explicitly resolving 
the halo. 

— A halo with an angular distribution which is wide com- 
pared to the resolution can be detected directly; since 
much of the directional signature is lost in this case, 
the evaluation of the background due to cosmic rays 
becomes then a critical issue. 

The background mentioned in the third scenario results 
from the small fraction of charged cosmic rays with a 
shower evolution similar to that of gamma-ray showers. 
Since it is uncertain if this remaining background can be 
modeled with sufficient precision by the simulations, fre- 
quently an off-source region is used to measure the back- 
ground. In case of the HEGRA telescopes, the source is 
placed 0.5° off axis in declination, and a region displaced 
by 0.5° in the opposite direction is used as a background 
region. The sign of the displacement alternates from run 
to run, to minimize systematic effects. Compared to dedi- 
cated off-source runs, this method has the advantage that 
the off-source data are taken at the same time and under 
exactly the same weather conditions and operating condi- 
tions as the on-source data; in addition, the on-source ob- 
servation time is maximized. A disadvantage of the tech- 
nique lies in the small separation of 1° between the on- 
source and off-source region. For a source extended on this 
scale, the off-source region also contains genuine gamma 
rays, and the background subtraction reduces the signal. 
A diffuse source generating a uniform distribution cannot 
be detected by this method. For a halo with an extent of 
a few degrees, this problem can be circumvented by using 
background data obtained from a different region of the 
sky; since these data are usually not recorded under identi- 
cal conditions, systematic uncertainties in the background 
estimate will increase. 

In the following, we will first examine, with the stan- 
dard background subtraction, the angular distribution of 
gamma rays, searching for qualitative indications of a halo. 
We then use models for the halo angular distribution to 
quantify the results. Finally, the halo flux is recalculated 
using a distant background region to cover the case of a 
halo with a smooth distribution on degree scales. 
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Any component of the gamma-ray flux which is ex- 
tended on the scale of a few tenths of a degree or larger 
should not show any observable time variation, due to the 
large variation in path lengths. Burst-like emission behav- 
ior of the source is completely averaged out. Therefore, 
the presence of an extended halo component should cause 
a flux dependence (and time dependence) of the angular 
distribution of gamma rays; for high flux, the point like 
source component dominates, whereas for the quiescent 
flux the extended halo is enhanced. 

In a first search for indications of a halo, the ratio of the 
event rates in different annular regions around the source 
was studied as a function of time. Specifically, the flux in 
various angular ranges 9\ to 6*2 relative to to direction to 
Mkn 501 was compared to the flux in the central peak, 
8 < 0.05°. ..0.1°. No statistically significant evidence of a 
time dependence of the ratios was observed. 

In the following, we will concentrate on the flux de- 
pendence of angular distributions and specifically com- 
pare the high-flux burst periods with the quiescent state 
of the source. Fig. 1 shows the angular distributions of 
gamma-rays from Mkn 501, after background subtraction, 
both for the 1997 high-flux burst period (Aharonian et al 
1999a, 1999b), and for the 1998/99 quiescent state (Aha- 
ronian et al. 2000a), excluding the flare on June 26-28, 
1998 (Sambruna et al. 2000). We note that with the event 
selection used here, the detection efficiency of the tele- 
scope system, i.e. its effective area, is constant to better 
than ±3% for 9 between 0° and 0.5°. In the angular dis- 
tributions for the high-state and quiescent-state angular 
distributions (Fig. 1(a) and (b), resp.), no dramatic differ- 
ence is observed. The distributions shown in Fig. 1 are not 
exactly Gaussian, reflecting the fact that the contributing 
events have angular resolutions varying between 0.04° and 
0.10°. The distributions are well described by a sum of two 
Gaussian distributions in 9 (solid lines). 

To characterize the angular distribution as a function 
of flux, data were binned according to the average flux 
measured in each night of observations, and the distri- 
bution in 9 2 was determined for each bin independently. 
Six flux bins were used for the 1997 burst data; a seventh 
"bin" contains the 1998 quiescent-phase data, excluding 
the June 26-8 flare. The average flux in 1998 is below the 
flux of the lowest 1997 flux bin. Two quantities charac- 
terizing the distribution were examined for each flux bin: 
the width of the central peak of the distribution, approx- 
imated by a single Gaussian (Fig. 2(a)) and the yield of 
gamma-ray events detected in the angular range between 
0.22° and 0.50° from the direction to the source, normal- 
ized to the yield inside 0.22° (Fig. 2(b)). The first quantity 
is sensitive to a halo with an angular width on the same 
scale as the angular resolution of the instrument, the sec- 
ond to a halo component with a width significantly larger 
than the angular resolution. Neither quantity shows a sig- 
nificant dependence on the flux, and the measured val- 
ues are consistent with results of simulations of the point 
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Fig. 1. Angular distribution dN/d# 2 of gamma rays rela- 
tive to the direction of Mkn 501. (a) For the 1997 burst 
period, and (b) for the 1998/1999 quiescent state, exclud- 
ing a short flare in June 1998. Background is subtracted 
using an off-source region separated by 1° in declination 
from the source region. The lines indicate a fit by a su- 
perposition of two Gaussian distributions in 9; the same 
shape is used for both data sets. 



spread function of the HEGRA instrument, using the mea- 
sured energy spectrum as an input. 

In order to provide a flux limit on the halo flux, a 
model for the shape of the halo is required. Two variants 
were investigated. 

- A Gaussian distribution, dN/d9 2 ~ exp(-9 2 /2aj lalo ). 

- The distribution dN/d9 2 ~ 1/9 (Fig. 3). The halo 
simulations of Aharonian et al. (1994, 1995) typically 
show, for small angles, a distribution N(9) ~ 9 where 
N(9) is the number of halo photons inside a cone of 
opening angle 9, equivalent to dN/d9 2 ~ 1/9. 

To derive limits, the angular distribution of the quiescent- 
state data was fit by a linear combination of the high-state 
angular distribution, and a halo contribution. The fit cov- 
ers the range in 9 2 from to 0.25. For none of the halo 
models, a significant halo contribution was found, and we 
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Fig. 2. (a) Gaussian width of the angular distribution of 
gamma-rays relative to the direction to Mkn 501, as a 
function of the gamma-ray flux. The point for the lowest 
flux is obtained from the 1998/99 quiescent-state data; 
the points at higher flux are based on data from the 1997 
outburst. The dashed lines indicates the result of the sim- 
ulation, (b) Flux in the angular range 0.22° to 0.5° relative 
to the source, normalized to the flux inside 0.22°. Back- 
ground is subtracted using an off-source region separated 
by 1° in declination from the source region. The error bar 
on the dashed line indicates the statistical error of the 
simulation results. 



give in Fig. 4 the 99% upper limits on the halo flux within 
an (half-)opcning angle of 0.5° around the source (solid 
line). The fit and the quoted limits take into account the 
spill-over of signal photons into the background region for 
wide halos. The flux limits for the Gaussian halo are lowest 
for the region of intermediate halo scales, (JHaio ~ 0.1°, 
and deteriorate both for narrow halos, which cannot be 
distinguished from the direct flux, and for very wide ha- 
los, where the spill-over into the background region limits 
the sensitivity. The dashed line in Fig. 4 indicates the limit 
obtained for the halo model with N(8) ~ 8, see Fig. 3. A 



°0 0.05 0.1 0.15 0.2 0.25 

2 [degr. 2 ] 

Fig. 3. Expected angular distribution of halo photons for 
the assumption N(8) ~ 8, equivalent to dN/d8 2 ~ 1/8. 
The dashed line shows the original distribution, the full 
line the distribution resulting once the angular resolution 
of the instrument is folded in. 



halo flux corresponding to the limit would roughly triple 
the expected number of events in the angular range from 
0.22° to 0.5°, see Fig. 2(b). All limits assume that the en- 
ergy spectrum of cascade photons resembles the spectrum 
measured for the quiescent state, i.e. show a power law 
with an index around 2 and a cutoff at a few TeV. 




-2 

10 1 ; 1 — J 

10" 1 
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Fig. 4. Full line: upper limit (99% C.L.) on the halo flux 
above 1 TeV, integrated up to 0.5° from the source, assum- 
ing a Gaussian distribution of halo photons, dN/dd 2 ~ 
exp(— 8 2 /2<j 2 Halo ) as a function of the width a Halo - Dashed 
line: limit for a distribution dN/dd 2 <~ 1/8. 



As discussed earlier, a more model-independent limit 
on the halo flux can be obtained by using a distant re- 
gion for background subtraction, rather than the region 
displaced by only 1° in declination. Data taken on other 
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objects can, e.g., serve as a background region. The diffi- 
culty is that already minor changes in the performance or 
calibration of the instrument can change the background 
yield. As an example, Fig. 5(a) shows the distribution 
in the mean scaled width of images for a halo region in 
the Mkn 501 quiescent-state data, and in an equivalent 
region in Crab data taken at a different time. In this 
case, the 'halo region' was defined as a ring around the 
source, with an inner radius of 0.33° and an outer radius 
of 1°. Together with the required angular resolution of 
better than 0.1°, the inner cut ensures that virtually no 
direct gamma-rays spill over into the background region. 
Fig. 5(b) illustrates, for comparison, a weak gamma-ray 
signal peaking at a mean scaled width of 1 . While the two 
distributions shown in Fig. 5(a) are quite similar, there 
are differences in the shape, both in the gamma-ray region 
(mean scaled width between 0.8 and 1.2) and outside. The 
differences can be explained by systematic shifts of the 
distribution by as little as 0.01 to 0.02 units, caused e.g. 
by changes in the alignment of the telescope mirrors with 
time. The maximum allowable number of gamma-rays in 
the halo region depends on exactly how the two distribu- 
tions are normalized to each other, before performing the 
background subtraction. Worst-case assumptions allow a 
photon flux of 1.1 • 10~ n /cm 2 s above 1 TeV in the angular 
range between 0.33° and 1.0° from Mkn 501, equivalent 
to 1.3 ■ 10~ 8 /cm 2 s sr. Work is in progress to better under- 
stand the differences in the distributions, to allow a more 
reliable background subtraction. 

4. Concluding remarks 

The search for a pair halo surrounding the direct TeV 
gamma rays from Mkn 501 shows no indications for a halo; 
the angular distribution in the quiescent phase - where a 
halo should be best visible - is within errors identical to 
the distribution during the burst phases. The upper limits 
on a halo contribution depend on the model for the angu- 
lar distribution of halo gamma rays; both very narrow and 
very wide halos are difficult to detect. In the region of op- 
timal sensitivity, the upper limit on the halo flux within 
0.5° from the source is around 1/1000 of the peak flux 
during bursts. For conventional halo models (Aharonian 
et al. 1995, 1994), and 'nearby' sources such as Mkn 501, 
the flux within 0.5° is O(10%) of the total halo flux (for 
the more realistic 'high IR' variant of the model), so that 
the total halo flux is limited to 0(0.01) of the peak burst 
flux. This value is above the expectations on the basis of 
energetics, and does not seriously constrain models un- 
less a very large duty cycle or a very poor beaming of the 
direct radiation is assumed. The situation changes if one 
assumes the dramatic absorption of gamma rays above 10 
TeV, as implied by recent measurements of the density of 
the infrared background radiation; such scenarios imply a 
huge source power at very high energies and correspond- 
ingly a strong halo. 




0.5 1 1.5 2 2.5 3 
Mean scaled width 




Mean scaled width 

Fig. 5. (a) Distribution in the mean scaled width of images 
in the halo region of the quiescent-state Mkn 501 data 
sample (full line), compared to the same distribution for 
the Crab data sample, scaled up to the Mkn 501 data. The 
halo region covers angles between 0.33° and 1° relative to 
the source, (b) Distribution for gamma rays, in this case 
for the quiescent-state Mkn 501 data, after background 
subtraction. 



A narrow halo with a width in the 0.1° range would be 
generated if intergalactic magnetic fields are very small, in 
the range below 10~ 16 G (see also Plaga 1995). Detailed 
cascade simulations will be required to determine which 
range of model parameters can be excluded; this goes be- 
yond the scope of the present paper. 
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